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Abstract 

The expectations and E[Y of the minimuin of n independent geometric, modified 

geometric, or exponential random variables with matching expectations differ. We show how this 
is accounted for by stochastic variability and how equals the expected number of 

ties at the minimum for the geometric random variables. We then introduce the “shifted geometric 
distribution”, and show that there is a unique value of the shift for which the individual shifted 
geometric and exponential random variables match expectations both individually and in their 
minimums. 
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1 Introduction 


The purpose of this note is to compare the distributions of the minimums of two sets of random vari- 
ables, respectively with geometric and exponential distributions, having pairwise matching means. 
The geometric distribution is the discrete analog of the exponential distribution and can be applied 
to a variety of performance models which can be analyzed by analytic or simulation methods. The 
following notation is used: 

• IN = {0,1,2,.. the natural numbers. 

• IN + = {1,2,3,-..}, the positive natural numbers. 

• N = {1, 2, . . . , n}, the first n natural numbers (n is a constant which will be clear from the 
context). 

• F A (t) = Pr{v4 < a}, the cumulative distribution function (CDF) of a random variable A. 

• F A{t) — 1 — /^(J), the complement of the CDF of A (its survivor function). 


2 Geometric, modified geometric, and exponential distributions 


Two random variables X and Z are said to have a geometric distribution with parameter a £ (0, 1), 
X ~ Geom(cv), and a modified geometric distribution with parameter (1 £ (0, 1), Z ~ ModGeom(/?), 
[4] if their probability mass functions (pmfs) are, respectively, 

VAr € IN + , Pr{A" — k} — a(l — a) k ~ } and 


Vi fc £ IN, Pr{Z = k} = (3{\ - fi ) k , 

from which it follows that their CDFs at the mass values are 

k 

Mk £ lN + ,Pr{X < k} = ~ a ) l ~ l = 1 - (1 - <*) k and 

/=i 


k 

VAr £ IN, Pr{Z < k} = J^/3(l - 0) 1 = 1 - (1 - /?)* + \ 
/=o 

and that their expectations are 


E[X}= J2 ka ( l 

k = 1 


— and 
a 


00 \ - ft 

m = = 

k = 0 P 

Informally, the difference between a geometric and a modified geometric distribution with the 
same parameter is the way in which they count: the geometric distribution starts at one, the 
modified geometric distribution starts at zero. Hence, if X ~ Geom(a), X — 1 ~ ModGeom(a). 
Equivalently, the geometric distribution models the trial number of the first “success” in repeated 
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independent Bernoulli trials, whereas the modified geometric distribution models the number of 
trials before the first success. 

The above assumes that the “time-step” of the distribution is the same as the units in which 
time is measured. This restriction is removed by considering X and Z as random variables assuming 
values in {kw : k £ IN + } or {ku : k £ IN}, respectively, for some time-step u> >' 0: 


X ~ Geom(a,u;) V£ £ 1R, Pr{A r < /} = 


1 — (1 — if t > 0 

0 otherwise 


and 


Z ~ ModGeom(/i,cj) <=> V/ £ IR, Pr {Z < £} 


l -(l 

o 


if t > 0 
otherwise 


which imply 

VAr € IN + , Pr{X = ku} = a( 1 - a ) k ~ 1 and 


Vfc € IN, Pr {Z = ku} = /?(!- fif 


and 


E[X] ~ — and 
a 


E[Z} = 


P 


It is well known that both the geometric and modified geometric distributions are discrete 
analogs of the exponential distribution. In particular, given an exponential random variable Y 
with rate A > 0, 


Y ~ Expo(A) <=* V* > 0, Pt{Y < t} = 1 - e~ M ^E[Y] = A -1 , 


one can determine a and 0 so that A" and Z match Y in expectation: 

E[ X] = — = A -1 = E[Y] => a = \u and 

and then, using these values for a and /j, the distributions of X and Z approximate that of Y 
arbitrarily well as the time-step u is reduced: 

lira Pr-LY < <} = lim 1 - (1 - \u >) UJ = 1 - c~ M = Pr{K < t } and 

lim Pr{Z < i] — lim 1 — ( 1 — - — ~ — ^ — 1 - e~ Xt — Pr{T < £}, 

u;|0 1 “ j u;iO V 1 + Aw / 

Note that a = Au £ (0, 1) implies a? < A -1 , that is, it is not possible to match the mean of an 
exponential random variable Y ~ Expo(A) with a geometric random variable having a time-step 
oj > A -1 . In the special case u — A -1 , a = 1 and the distribution of X degenerates to a constant: 
A r ~ Geom(l,u>) = Const(u;). In the following, we allow this case and require u; £ (0,A _1 ]. No 
such restriction exists in the case of the modified geometric distribution, where any u > 0 can be 
used. 
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3 The minimum of a set of random variables 


Consider now three sets of n > 2 independent random variables, {Xi : i G N}, {Z, : i G N), and 
{V- : i G N} with matching means: 


Vi G A r , X t ~ Geom(fti,a;), E[X{] - X t 1 a t - \{UJ y 


Vi G A\ Zj ~ ModGeom(/?t,u>), E[Z t ] — X t 1 => # = - — — — , and 

1 -b AjCJ 

Vi € N, Y{ ~ Expo(A ! ), £[>:] = A” 1 . 

Since u; G fte/vCO, A" 1 ], we obtain u> G ( 0 > w * iere = max{A, : i G #}• 

It is well known that the minimum of each of these sets has the same type of distribution as 
the elements of the set [5, 2]: 


X'j!) = min{A r j : i G A r } ~ Geom ( 1 — JJ(1 — a,-),u; J , 

V ieN / 

{Zi : i G N} ~ Mod Geom i-no and 

V ieN / 

Expo ( • 

Vie at / 


Z ^ j = min 


= min{V, : i £ N} ~ 

Hence, Z^j, and Yjj) have different expectations: 

£[*( 1)1 : 

E[Z( i)] = 


UJ 

UJ 

” i - no-o " 
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1 

e 

ieN 

%eN 

ojUil-fc) 

i£N _ 

UJ 


* £* 
\i€N > 


£[V (1) ] and (1) 


1 - U ( 1 - /i.) — 1 + JI ( 1 + A,-w) 

ieN ieN 


t X> =c['o)t 

\i£N / 


(2) 


Theorem 1 . For n > 2, > £[V(i)] > E[Z^. 

Proof. We prove that £[A r (i)] > £[Vnd by induction on n, hence we make the index n explicit 
by writing £[X (lin) ] and £[V(i, n )]. 

Base step: For n = 2, 


E [ A (b2)l i_(i_A,w)(1-A 2 w) A, + A 2 -A,A 2 w > A, + A 2 £? ^ (1 ’ 2) ^' 
Inductive Hypothesis: Assume that, for a given n, E[X^^] > £[V(i }n )]- Then, 


u ; 


i - no - Aiw) 

ieN 


> ( X) ) =* II( 1 - A ^) > 1 - X a ^ 


\ieN 


ieN 


ieN 
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Geometric Exponential Modified Geometric 



Figure 1: E[V(i)], and E[Z^)] (n = 1, • * * ,5, Vi, A; = 1) as a function of u>. 


Inductive Step: Then E[A^ ljU+1 )] > E[Y( ln+1 j], since 




OJ 


> 


1 - I £[( 1 ~ A * W ) I C 1 _ MM 

\ieN / 

UJ 

1- (l-£ Ku | ( 1 - A n+1 u>) 

V ieN / 


y: a % + a u+ i - 1 a i j a 

ieN \i€N / 


71+1 


CJ 


>( £ A ‘ =^(l.n+l)] 

\ieN U{«+1} / 


The proof that E[Z^\ < £[1^] is analogous and is omitted* QED. 

In other words, the minimum of n independent exponential random variables is always strictly 
bounded in expectation by the minimums of n independent geometric and modified geometric 
random variables with matching means. For example, if n — 2, and Ai = A -2 = A, 

£[*(«)] = OM - M2))' 1 > £?[K (1) ] = (2A)- 1 > E[Z (X) ] = (2A( 1 + A^/2))" 1 . 


E[X^] and E[Z ^j] coincide with E[Y^] only in the limit, as u; j 0 (see figure 1): 


u u 

lim E [A (1) ] = liin == = lim — ; . , J 

"l'o "I 0 l-IIO ~ M) " l0 ^A t w + o(cj) \f^ N 


-1 


Y x n = E i y w} a « (1 


ieN 


ieN 


lim E[Zn\] - lim =^~ 

wio 1 [l)i u/JO _1 + JJ(] 


= lim 


CJ 


E G = n.)3- 


(1 + Aj-o;) ^ A {uj -f o(cj) \ t - G jv 

ieN ieN 

The convergence of E[X^] and E[Z^} to E[Y^} as to J 0 can also be derived observing 


that 


E[X (l) ] - u < E[Z {X) ] < E[Y (X) ] < E[X (x) ] < E[Z {X) ] + W> 

which follows from the fact that (A,- - u>) ~ ModGeom(«,, u>) and (Z t + u>) ~ Geom (/?,-,<*>), and 
from Vi € iV, a, < which imply that E[X^ — o>] < E[Z^ and E[Z 4- w] > £'[A r ( 1 )]. 

The next section contains an explanation for these inequalities. 
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4 Stochastic variability 


Random variables with the same mean can be compared using the notion of stochastic variability, 
described in Ross [3], for which there are two equivalent definitions. Y is said to be stochastically 
more variable than A", A^ < v V\ if 

V increasing convex function g , E[g(X)\ < E[g[Y)\ 

or, equivalently, if 

7 1 J too roo 

Va > 0, / F x (t) dt < / F Y {t) dt. 

J a J a 

An additional useful notion codifies the idea that the remaining lifetime of a random variable 
conditioned on exceeding some value a has never greater expectation (NBUE: New Better Than 
Used in Expectation), or never smaller expectation (NWUE: New Worse Than Used in Expecta- 
tion), than the original lifetime. Formally, a nonnegative random variable A is NBUE if 

Va > 0, E[A — a | A > a] < E[A } 


and is NWUE if 

Va > 0,E[A - a | A > a] > E[A ]. 

Ross lists some important consequences of these definitions: 

• If A" and Y are nonnegative, X < v T, and E[X ] = E[Y ], then —A" < v —Y. 

• If g : IR Tl — > IR is an increasing convex function, if Vi G N y X t < v Y{, {A", : i G iV} are 
independent, and {Y{ : i G N} are independent, then 


g(X u X 2 ,...,X n )< y g(Y u Y 2j ...,Y n ). 


• If X is NBUE, and V r is exponential with the same mean as A r , then X < v Y. 


• If Z if NWUE and Y is exponential with the same mean as Z then Y < v Z . 


These last two facts are used to relate X ~ Geom(a,u;), Z ~ ModGeom(/j,a>), and l r ^ Expo(A) 
w'ith the same mean, by showing that the geometric distribution is NBUE and that the modified 
geometric distribution is NWUE. Let X ~ Geom(a,w), Z ~ ModGeom(/3,u?), and choose any 
a > 0. Using the memoryless property of the geometric distribution, we can derive: 


E[ X - a | X > a] 
E[Z — a | Z > a] 


E[ X | A' > a] - a = 
E[Z | Z > a] - a = 


1^— J u> + E[ X] — a < E[ X] and 
(^-\ + l^u+ E[ z )- a > E\ z }. 


Therefore, X < v Y < v Z . 

Considering again the three sets of independent random variables with matching means {A, : 
i £ {%i : 2 £ A T }, and {V; : i G N } observe that 


min {a; : i G N } = — max{— a{ : i G N}. 



Since max is an increasing convex function and Vi £ N,—X t < v — Vi < v — 

max{ — A"* : i £ A r } < v max{ — : i £ A 7 } < v max{-Z* : i £ A 7 }, 


implying that 

— E[max{—Xi : i £ N }] > -^[max{-V; : i £ A r }] > -£[max{-Z; : i £ A T }], 
and thus that 

E[min{X 4 - : i £ AT}] = E[ X^] > E[min{yj : i £ N}] = £[V(i)] > E[min{Z t - : i £ A r }] = £[Z (1 )]. 


5 Matching the minimums by changing the time-step 

This section presents an explanation for the existence of the strict Inequality (1), and its quantifi- 
cation, based on the possibility of a tie for the minimum in the set { X t : i £ A 7 }. A confirmation 
of this intuition is found by defining a new random variable, W^y obtained dividing X by the 
expected number of random variables tied for the minimum: the expectation of this “weighted 
minimum” W(\) is indeed the same as that of T(i)- 

The discrete nature of the geometric distribution implies that several random variables in 
{X x : i £ N} might coincide with X^y Define /jq to be the the set of indices among {l,...n} 
corresponding to such random variables (/^] is itself random); 

I[x] = {i€N:Xi = X { 1 ) }CN 9 I M tQ. 


The pmf of /^] is 


Vs C N i s^^?r{I [l] = s) 


Pr{Vi € X, = X {1) A Vj € N \ s , X 3 > A' (1) } 

oo 

Y Pr{Vi £ 5 , X x — ku> A V? £ A r \ s, X j > ku>] 

k=\ 

£(n«,(i-«, )'"-■) { n 

k=\ Vies / \j^N\s / 

( n (!-«,)] 

&= t Vies I \j(~N\s / \/6A r / 

(n«.) ( n o-«,) 

\«6s / \jeN\s 

i- no-*) 

leN 



This result is more easily obtained observing that, because of the absence of memory of the geo- 
metric distribution, and are independent, hence Pr{/[q = $} is simply the product of the 
one-step probability of success for the elements of and of the one-step probability of failure for 
the elements not in .s, normalized by the probability that at least one success occurs. 
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A 2 - AiA^J 
1 - (1 - «i)(l - a-i) Ai + A ' 2 - Ai A 2 W 
aia 2 X ' X * U _ 


'For example, if » = 2, the three possible values for /,„ and their probabilities are: 

aj(l-a 2 ) Ai - AiA2 <^_ 

Pr{/[i] = {!}} = P, {- Y ' < = r^TT- a, jo - °2) a, + A 2 - A,A 2 w 

a 2 (l ~ «i) 

Pr{ / [i] = {2}} = Pr{Xi < A 2 } - 

L- , - 

Pr{/[i] = {1,2}} = Pr{- Y i = Xi) = f— (T^0(1 -~«2) _ Al + Ai " AlAiW 
1„ general, the probability that a particular X, is equal X ( „, or that i £ /„), 

Pr{.V, = X,,,} = £ Pt{X, = tu> A Vy £ IV, i # •, Xi - M 

fe=l 

= £ o.(i n 

k = 1 jGiV,j/« 

00 1 1 

= E'blle- 0 ^ 

k~ i jeN 

Oj 

1 - no "“j)* 

j€N 

hence, the expected number of completions at time X (1) among {X, : i € X} .s 

E"' 

tG/V 

Wmll - E ?r t Xi = x w ' 

iGN AX 


ieN 


We can define the “weighted” random variables {VP, : i € X}, where 

/ . 

X 


Vi € X, VP, 


£[|/[t]ll 


~ Geom a i, 


CJ 


X[U[i 


= Geom 


jeN 

«{,<*> • - 


V 


E a « 

iGN 


/ 


which are still geometrically distributed random variables with the same success probabilities a, 

i , r y * i c AT \ hut with a reduced time-step, lnen, 

their original counterparts \X t . i € /V), 

' -- ^ X - 


J a 


VP (1) = min {VP, : i G X} = min j ■ 


:ie XV = 


(1) 




tabes into account simultaneous completions by dividing the inmnnumconipletiontune by the 

- — 

- - - 

exponential case: 

u 


E[W W ) = 


x (1) 1 

E[ A (l)l _ 

i - no-*) 

i&N 

U> 

(x>)” 

1'EIUwlll 


£«. 

z*GN 

~~ E°. 

,eN 


i - no-*) 

jeN 
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We conclude this section by observing that, while the result E\Wt J — F\Y i 

ir r ,ies are tie ^ ° f ^ o, *>. „ .* jls ^ 


V * € N,x* ~ Geom(a*, w,-), £[**] = ~ = A" 1 = £[y;] 


, V? € Nyj e N, i zfc J y the ratio w, •/<*>,■ is not a rational number, hence it is not possible to 
*" d tWO "“' gers *» “« k * ,lla ' »»“W *■«'<» i„ a potential tie a, ,i„,e k„ l 

6 Matching the minimums by time-shifting 

In ‘h p previous section, we force,, the expectation of the minimums of {X, : i 6 y, M(] ,y . 
I ‘° 7 T l TM i: he “ m '- SleP ° fthe ~ distributions, that Ts/transformhig 

interesting resnl. iuid L ,o ^oi!U«,^ !?. ^ ™ 

a J^Z7Z7 rM “ aC,l, ‘ hiS " y l "‘ rod " th * ‘ he ^ •“■•««■ retribution, 
g nerabzat.on of both the geometnc and modified geometric distribution. Given 0 < o < 1 

" , ’ “ d " € K ; - ** " ,at - 9 distribution with parameters ~J 

v, S ~ Shift Geom(a,w, tr), if its pm f j s ’ ’ 


which implies that its CDF is 


Vfc 6 IN, Pr{5 - ku + ct} = a (i _ 


W € 1R, Pr{,? < t} = / 1 ~ - «)L < ur' T J +1 if / > cr 


and that its expectation is 


otherwise 


E[S) 


1 — a 
a 


-a ; + a. 


in other words given a random variable H ~ ModCeom(„), „ > 0 , and „ 6 R, S . + „ „ 

shifted T 2 Sl ' OWS "" rclatio " shi P s ‘he geometric, modified geometric 

shifted geometric, and exponential distributions. 

expe^UtioI ^ ^ Can aga5n C ° nSider the COndition ,,n(ler whifl > S and Y have the same 

E[,9] = i—2:^ + cr = A' 1 = E[Y] =» a = ^ 

c . . . 1 — aX + u)X (^) 

■ mce a is a probability, it can only have values in [0, lj. Furthermore, £[i’j = cc when « - 0 so 

I' -** ** * «> >' ‘ b e same expectation for ^ IL of o, ^ 


0 < a = 


u>X 


< 1 => cr < A 


-1 


1 - <jX + u;A - 

and a is set according to Equation (3). A few observations are of partied* interest: 
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Figure 2: Relationships between the distributions discussed in this paper. 

• Once the value of E[S ] is fixed at A - " 1 , decreasing the time-shift a by 6, possibly below zero, 
causes a decrease in a, so that E[A] increases by 6/u? and E[S] = E[A]lj — <j remains constant. 
Since E[A\ can be arbitrarily large, this explains why there is no lower bound for a. 

• If ct = 0, S ~ ModGeom(o, u). 

• If u) < A” 1 and a — cj, S ~ Geom(o,cj). 

• If cr = A -1 , a=l, hence S ~ Const(a) = Const(A _1 ). 

Consider now a set of modified geometric random variables with time-step one, {A; : i E N} 
and the set of shifted geometric random variables {.9, : i G N) obtained from them by changing 
the time-step to u and applying a time-shift cr. 


Vi E N 7 Ai ~ ModGeom(o,), S{ = A t u + a => S z ~ ShiftGeom(cv t ,6j, a) 
and set the parameters {a, : i E iV} so that; 

Vi € N, £[5,] = + o = A- 1 = Em => a, = - ^ 

a* I — aA, + u?\i 

Since Vi E ^,0 < a t < 1, the maximum value of a is 

* ^ K 1 } = = x max- 

The expectation of .9^ j = min{5, : i £ N} - + a is then 


no-«o 


£[.%>] = 


ieN 


i- no-*) 

i£N 


U) -h <J 
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n 

ieN v 


UJ A 2 


1 — (7 A ; -b UJ A j 


.-nO-rdfc) 


uj + a 


no-^-) 

ieN 


PJ (1 — <tA, + u;A;) — J"J (1 <tA{) 

ieN ieN 


■u> + a = 


Pn 


tfn Pn 


-u> + a 


where 


Pn = 11(1 - cr\i) and q n = JJ (1 - a\ l + u>\i) 
ieN ieN 


satisfy 

• V<r < A MAX ’ P n ^ 

• Pn| CT=0 = l - ( 7»I<t= 0 = Eh 1 +WA,) > 1. 

ieN 

• Pn|^— \“ l 

a — 'MAX 

• If w < ^MAX ’ < 7n| (7=w = 1- 

Theorem 2. There exists a unique value <x* < A max f° r which E[S(i)] = £[F(i)]- 

Proof. To show the existence of rr* , it is sufficient to observe that £[5(1)] is a continuous function 


of a over ( - oo , A M ' 4 x ] , that 


u> 


< 


* [5(i)] L=o no+^)- 1 ' ^ 

ieN 




e[y {1) ] 


(this is Inequality (2)), and that 

C[S',,)] 


T = X 


-1 

MAX 


\V/.« 


; A x>(e*.) =moi- 

\ieN / 

Hence, by continuity, there must exist a value a* G (0 >^xiax) satisfying 

«M,„. = cm.)]- 

Furthermore, if u < Ml AX , 


E[S 


(l) 

V f '<T~UJ 


11(1 - ujX i) 

ieN 

1 — ( 1 — u;Ai) 

ieN 


uj + to 


UJ 


1 “ XT ( 1 “ u7 ^«) 'ieN 

ieN 


>( 5 >) = E ^ 


(this is Inequality (1)), hence, in general, <?* € (0, min{u;, XjJ ax }). 

We prove the uniqueness of ct* by induction on ft, showing that E[S^} is a strictly increasing 
function of <r over ( — oo, Aj^ 1 ^], hence we make the index ft explicit in E[S( j)] by writing 

E[S(i,n)] = min{,9 t : i G N}. 
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Base step: For n = 2, 


1,2 J - 


(1 - <tAi )( 1 - (T A 2 ) 


u> + a 


and 


(1 - a A) + wAi)(l - ct \-2 + cjA 2 ) - (1 - a Aj)(l - a\ 2 ) 

1 + <jA 1 A 2 (a? - a) 

A] + A 2 + A 1 A 2 (o; — 2cr) 

dE[S{i ,2)] _ A] A 2 (cj(Ai + A 2 — 2Ai A 2 <t ) + 2 ( 1 — <tA^ — aA 2 + a 2 A] A 2 ) + A 2 ) 

da (Ai + A *2 + A]A 2 (cj — 2<r)) 2 

>0 for <r<\- l AX 

— — M 


Ai A 2 (u>(A] (1 ~ (T A 2 ) + A 2 (l — ctAi ) + 2(1 — <jA] )( 1 — <tA 2 ) -fa> 2 Ai A 2 ) 
(Ai + A 2 H" A]A 2 (u; — 2a)) 2 


> 0. 


In particular, 


lim E[S{ \ 2 )] = — oo and lim 

(j — ► — oo ' ’ * rr — ► — r» 


dE[S( i >2 )] _ 1 


da 


and 


^[^(1,2)]| <t=a _i — AX aTU I 


dE[S { M) ] 

da 


u> 


CJ 


cr— AT 


u + ^MIN ~ ^ MAX 


\ — 1 ? 
K U> + a M j N 


where A \UN = min{A],A 2 ). 

Inductive Hypothesis: Assume that, for a given n , 


E[S { ,,«)] = 


Pn 


-u> + a 


Qn Pn 

is a strictly increasing function of a over ( — oo, A ^ 1 ^ x ], that is 


which implies 


,«)] _ PnOn -Pn)- PnWn ~ Pn , , Pn ( In ~ Pnrf n , , ^ n 


V(t € (-oo, A m AX \, u>{p' n q n - p n q' n ) > ~{q n - p n f 


Inductive Step: Then the same holds for n + 1, that is, 


■^[•^(1,71+1)] — 


Pn+ 1 


-w + a = 


p n (l - a A n+ i ) 


rw + 


q>i+i — Pn+i <7n(l — ^A„ + 1 +o;A n+ i) — p„(l - <rA n+1 ) 

where A u+1 is the rate of the (n+l)-th exponent ial random variable, is a strictly increasing function 
of o over (-oo, max{ Ay/ ,4* , A n+1 } _1 ], that is 


>-(?n-Pn) 2 for 


MAX 


rfg [- y (i,7 t +i)] _ (1 - <rA n+ i )(1 - ffA tl+ i + uA n + t ) (p' n q n - -A l+}^qnPn 


da 


> 


(<?7i(l - ^A, i+1 + wA n +i) - p„(l - <rA n+1 )) 2 
( 1 — rrA n +i )( 1 frA n _|_] + ^A n _|_] )( — (</n Pn) ) A n _j.]<*/ qnPn 

(?7i( 1 ~ f^An+i T u>A h _(_] ) Pn{ 1 ^Ajj-j-i ) ) 2 

A, 7+1 u(q n - Pn){{q n + Pn)(l - ^A, l+1 ) + A n+1 w< 7 n 


+ 1 


+ 1 


(7,1(1 — <tA u +i + wA n +i ) — p n ( 1 — (tA h+ i)) 2 


> 0 


since, a < A n | t and Vcr G (-<x>,max{AA#>ur, A n +i } 1 ],qr n > Pn« QED. 

We might now ask whether this value <r* for which £[5^] = E[Y^] is such that the other order 
statistics coincide as well, that is, whether 

Vi € A , i > 1 } £[5^)]| a=a * = E[Vj^]. 

This is indeed true for n — 2, since 

£[.9 0) ] + E[s m 3 = £[.9,] + £[£ 2 ] = £[Vi] + E[Y 2 ] = JB[y (1) ] + £[V( 2) ] 

implies that, whenever E[S^} = £[Y(i)], 

£[%)] = ^(2)] 

Unfortunately, this is not true in general for n > 3, as it can be seen considering the homogeneous 
case. When Vi € AT, A z = A, 

Pr{.5(2) > + ct} = Pr{/1(2) > A;} 

(Vi € N, Ai > k) V I \f ( 4 ; < fc A Vj e N,j ^ i, . 4 , > A*) 

Vie.v 

= Pr {Vi G A T , i4 t * > k] + ]T Pr -{^ < k A Vj £ NJ ? i, > A;} 

t€N 

= ((1 -a) n )* +1 +n(l -(1 -a)* +1 )((l - a)"" 1 )** 1 
- »(1 - a ) (n ~ 1)( * +1) - (n - 1)(1 - a) n(fc+1) 





It can be easily verified numerically, for example when n = 3, u = 1/2, A = 1, that the only real 
root of £[£(!)] = E[Y{ 1 )] is a « 0.173927, while the only real root less than A -1 of E[S { 2 )] = ^[^( 2 )] 
is a « 0.346961. 
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7 Variate generation application 


The results of Section 3 can be used in variate generation for Monte Carlo simulation. For brevity, 
only the geometric distribution is considered. Results for the modified geometric and shifted geo- 
metric distributions are similar. 

To generate a single Expo(A) random variate Y by inversion [1] 

where U ~ Unif(0, 1). The random number 1 — U can be replaced by U for increased speed 
although the direction of monotonicity is reversed. If Y ~ Expo(A) then \Y ] ~ Geom(l — c” A ) 
since Pr{[T] = k } = e“^' _1 ) A (l — c“ A ) for k 6 IN + . Thus to generate a Geom(o) random variate 
X requires only a single line of code 


A' 


Tn(l — U) ” 
In ( 1 — a) 


If the time-step is u>, then the appropriate modification to generate a Geom(rv,Ct;) random variate 


is 


X 


In ( 1 - U ) 


UJ. 


ln(l — a) 

The straightforward approach to generating the minimum Y^ of n exponential random variables 
{>< Expo(Ai) : i € N} is to generate n exponential variates U , . . . , Y n , then determine the 
minimum and the associated index (if required). This approach becomes time consuming as n 
increases. A much faster approach is to generate the minimum as 

In ( 1 — U) 


Y, 


0 ) 


S> ’ 

ieN 


where the denominator needs to be computed only once. This approach is both synchronized (one 
random variate from Unif (0 , 1), U l is needed to generate one random variate for Y^.) and monotone 
(given two random variates from Unif(0, 1), U\ and f / 2 , U\ < U' 2 = ^Y(\) 1 < W- To generate a 
variate corresponding to the index J of the minimum value, use the pmf 


Pr{J = j} = 


i£N 


for j 6 N . 

There are two cases to be considered when generating the minimum of geometric random vari- 
ables. The first is when the modeler wants the means of the individual random variables (but not 
of their minimums) to match. The second is when the modeler wants the means of the minimums 
(but not of the individual random variables) to match. Consider generating the minimum in 
the first case, where {Xi ~ Geom(<a;,cj) : i £ N}. First generate the minimum 




lnp - U) 

^ln(l - a,-) 
1 ieN 


13 


To generate a random set of indices /[!] corresponding to completion at the minimum value, use 
the pmf 


Pr{/ tl ] = 5 } = 


(n«>) ( n 0 - a ^ 

\i£s / \jeN\s ) 

i-nc-o') 

leN 


for 3 C A r , 3 y£ 0. 

There are two costs to consider when generating a set of indices corresponding to X^y The 
first cost is the set-up cost incurred once at the beginning of a simulation. If all of the 2 n - 1 subsets 
of indices are to be considered, the (0, 1) interval must be partitioned into as many pieces prior to 
generating any variates. The second cost, often called the marginal cost to generate a variate, is 
incurred each time a random variate is generated. It involves generating a Unif(0, 1) variate and 
searching the partition determined at the beginning of the simulation for the appropriate cell. This 
cell corresponds to a set of indices for the generated geometric random variable. The above scenario 
is worst-case, since time will be saved in both the set-up and marginal steps if, for example, the 
modeler is only interested in whether or not a tie occurred. 

The generation of W^y where the expected values of the minimums of the exponential and 
geometric random variables coincide, requires only a slight modification to the previous approach. 
At the beginning of a simulation, ^[1 /[i]|] should be calculated. Thus the reduced geometric is 


^(D 



where is generated using the previous technique. 


8 Conclusion 

We have shown how, if the random variables {A, : i € N}, {Yj : i £ N }, and {Z, : i £ A} 
model the same set of n concurrent activities rising geometric, exponential, or modified geometric 
distributions, respectively, with given expectations the expected value of the minimums are 

different, )] > E[Z^. Stochastic variability is employed to justify the result. 

We then consider two different ways to match the expectation of the minimums. First, by 
taking into account the possibility of ties in the geometric case, we define the “weighted minimum 
W (1) , and obtain £[W (1) ] = £[F(i)], but this operation corresponds to decreasing the time-step 
of the individual geometric distributions, hence their expectation. Alternatively, we introduce 
the “shifted geometric distribution”, which a generalizes both the geometric and the modified 
geometric. We can then define a set of shifted geometric random variables {.9, : i £ A }, which 
match in expectation the exponential random variables both individually, A [.S',] = A i l , and their 
minimum, £[£(,)] = E[Y^]. Generating variates is straightforward. 
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